To Beat or Not to Beat: Beat Gestures in Direction Giving
نویسندگان
چکیده
Research on gesture generation for embodied conversational agents (ECA’s) mostly focuses on gesture types such as pointing and iconic gestures, while ignoring another gesture type frequently used by human speakers: beat gestures. Analysis of a corpus of route descriptions showed that although annotators show very low agreement in applying a ‘beat filter’ aimed at identifying physical features of beat gestures, they are capable of reliably distinguishing beats from other gestures in a more intuitive manner. Beat gestures made up more than 30% of the gestures in our corpus, and they were sometimes used when expressing concepts for which other gesture types seemed a more obvious choice. Based on these findings we propose a simple, probabilistic model of beat production for ECA’s. However, it is clear that more research is needed to determine why direction givers in some cases use beats when other gestures seem more appropriate, and vice versa.
منابع مشابه
Beat Gestures in Direction Giving
When humans speak, they use gestures that “are not random but convey to listeners information that can complement or even supplement the information relayed in speech” [1]. To illustrate this, consider three of the main gesture types from [2]. Deictic gestures are pointing movements indicating the location of items being referred to. Iconic gestures depict a physical aspect of what is spoken ab...
متن کاملBeat that Word: How Listeners Integrate Beat Gesture and Focus in Multimodal Speech Discourse
Communication is facilitated when listeners allocate their attention to important information (focus) in the message, a process called "information structure." Linguistic cues like the preceding context and pitch accent help listeners to identify focused information. In multimodal communication, relevant information can be emphasized by nonverbal cues like beat gestures, which represent rhythmi...
متن کاملBeat gestures facilitate speech production
Does gesturing help speakers find the right words? According to several theories of speech-gesture relationships, iconic gestures should facilitate speech production, but beat gestures should not. Here we tested the effects of gesturing on word production in two experiments. Participants produced lowfrequency words from their definitions while instructed to perform beat gestures, iconic gesture...
متن کاملGiving speech a hand: gesture modulates activity in auditory cortex during speech perception.
Viewing hand gestures during face-to-face communication affects speech perception and comprehension. Despite the visible role played by gesture in social interactions, relatively little is known about how the brain integrates hand gestures with co-occurring speech. Here we used functional magnetic resonance imaging (fMRI) and an ecologically valid paradigm to investigate how beat gesture-a fund...
متن کاملThe effects of pitch accentuation and beat gestures on information recall in contrastive discourse
Research in audiovisual prosody has shown that typically beat gestures are temporally integrated with prominent positions in speech (e.g., [1, 2]). There is independent evidence that both prosodic prominence (e.g., pitch accents) and gestural prominence associated with words (e.g., beat gestures) facilitate the recall of information (e.g., [3, 4, 5]). However, previous studies did not directly ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2009